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[Abstract] 

[Problem to be Solved by the Invention] A face picture matchingsearch system is 
provided that is capable of maintaining matching processing with high 
precision even in the case where capturing environment, conditions, and the 
like are different between an input picture and a registered picture. 

[Means for Solving the Problem] A registered picture of a user is previously 
stored in a registered picture DB 40. In authentication processing, a user's 
face picture is captured by a camera 11 of a picture input part 10, and the 
face picture is analyzed by an input picture environment target estimation 
processing part 20, whereby an environment parameter and a target state 
parameter are estimated. For example, an illumination parameter showing 
illumination conditions, a capturing direction, a position parameter showing 
a face size and the like (dependent upon a standing position), an accessory 
parameter showing the presence/absence of an accessory such as glasses, a 
facial expression parameter, and the like are estimated. A matching picture 
generation processing part 30 extracts a registered picture from the 
registered picture DB 40, and adjusts a parameter value based on the 
estimated parameter values of the input picture, thereby generating a 
matching picture. A picture matching processing part 50 compares and 
matches the matching picture with the registered picture. 
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(Page 6, left column, line 39 — right column, line 16) 

[0030] The picture matching processing part 50 compares and matches the 
matching picture generated by the matching picture generation processing part 30 
with the registered picture to calculate the similarity therebetween. In 
Embodiment 1, the similarity is assumed to be a distance between the pictures on 
respective intrinsic spaces. An outline of a procedure of projection onto an intrinsic 
space will be described with reference to Figure 3. First, a face region is cut out of 
an input picture to obtain a face picture. The cut-out face picture is subjected to 
KL development (Karhunen-Loeve development. Hereinafter, abbreviated as "KL 
development"), whereby the face picture is projected onto an intrinsic space. The 
intrinsic space is obtained by creating a matrix composed of column vectors 
including pixel values of the face picture as elements, obtaining an intrinsic vector 
matrix from the matrix, and defining a space with the intrinsic vector matrix. 
Figure 3 shows only three axes of X lf X 2 , and X k for convenience. The face picture 
is projected onto this intrinsic space. The face picture of the registered picture is 
also subjected to KL development so as to be projected onto an intrinsic space. 
Since the input picture is adjusted, only one basic registered picture on a front side 
is enough. However, in this example, a plurality of registered pictures captured at 
a plurality of angles are prepared, a plurality of projection points are obtained on a 
user basis, and the projection points are continuously connected. In this example, 
the input picture is adjusted for parameters based on the registered picture having 
the most similar target state parameter, and the distance between the projection 
points should be obtained on an intrinsic space. 

[0031] As described above, the distance between the projection points of the input 
picture and the registered picture on the intrinsic spaces is calculated. The picture 
matching results are obtained by evaluating the calculated distance. Depending 
upon the application, a threshold value of a distance for determining authenticity is 
provided. If the distance is equal to or lower than the threshold value, authenticity 
is determined, and if the distance is larger than the threshold value, it is 
determined that the input picture is not in agreement with the registered picture. 



(Page 7, right column, lines 7 - 24) 

[0042] (Embodiment 2) The picture matchingsearch system of Embodiment 2 
according to the present invention conducts matching processing in the same 
procedure as that of Embodiment 1. That is, an environment parameter value and 
a target state parameter value are obtained from a captured input picture, a 
parameter value of the input picture is adjusted based on an environment 
parameter value and a target state parameter value of the registered picture to 
generate a matching picture from the input picture, and the matching picture is 
matched with the registered picture. At this time, matching processing is 
conducted on a partial picture basis in accordance with the Eigen- Window method. 
More specifically, for matching, a picture is divided into a plurality of regions, and 
each divided region is subjected to matching processing in accordance with the 
Eigen-Window method to calculate the similarity. Then, the similarity obtained 
from each divided region is provided with weighting set for each region to calculate 
the total calculated value, which is used as a picture matching processing result. 
In Embodiment 2, a picture matching- search system is assumed in which the input 
picture and the registered picture are face pictures showing human's faces, the 
input face picture of the user is compared and matched with the registered face 
picture of the user, whereby personal authentication is conducted. 

(Page 7, right column, line 45 — page 8, left column, line 32) 

[0047] A picture region dividing part 51 divides a picture into regions. In the face 
picture in Embodiment 2, the entire picture is divided into characteristic partial 
pictures. At this time, the region to be divided may be an entire face, or may be 
limited to a left eye region, a right eye region, a nose region, a mouth region, and the 
like. These partial regions are called window pictures according to the Eigen- 
Window method. For example, the window pictures are cut out as shown in Figure 
7. In division of a picture, the total (hereinafter, referred to as an "edge intensity") 
of differences in pixel values between each pixel and an adjacent pixel is calculated, 
a part of the picture is cut out as a window picture based on the edge intensity, the 
cut-out position (hereinafter, referred to as a "window position in a picture") and an 
identifier are added to a vector (hereinafter, referred to as a "window picture 
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vector") including pixel values contained in the window picture as elements, and 
window data is created. The edge intensity for cutting out a window picture is 
defined as the total of differences in pixel values between each pixel and an adjacent 
pixel. However, cutting out a window picture can also be determined by defining 
the edge intensity as a high-frequency component amount in a space frequency. 

[0048] The Eigen-Window matching processing part 52 conducts processing similar 
to the projection processing in an intrinsic space described in Embodiment 1, 
thereby projecting window picture data onto an intrinsic space. Figure 7 also 
shows only three axes of X L , X 2 , and X k for convenience. The cut-out window 
picture is subjected to KL development and projected onto an intrinsic space as 
shown in Figure 7. An Eigen-Window matching processing part 52 compares a 
projection point group of a window picture of an input picture on an intrinsic space 
with a projection point group of the registered picture to calculate the similarity 
therebetween. The distance between the projection points is calculated as the 
similarity. Herein, it is also considered that a window picture is subjected to DCT 
transformation, instead of being subjected to KL development, and the window 
picture is projected onto a feature space composed of DCT transformation 
coefficients. 

[0049] A weighting evaluating part 53 conducts predetermined weighting on a 
window picture basis, with respect to the distance between the projection points 
calculated by the Eigen-Window matching processing part 52, whereby the total 
calculated value is obtained. As an example of weighting, weighting of an eye 
window picture is 3, and weighting of a nose window picture and a mouth window 
picture is 1. The calculated total value is compared with a predetermined 
threshold value for determining authenticity, whereby authenticity is determined. 
More specifically, if the calculated total value is within the threshold value, identity 
is determined. 
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Fig. 3 




Fig. 7 
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(54) IMAGE COLLATION/RETRIEVAL SYSTEM 

(57) Abstract: 

PROBLEM TO BE SOLVED: To provide a face image 
collation/retrieval system capable of maintaining highly 
accurate collating processing even when the 
photographic environments or conditions of an input 
image and a registered image are different. 

SOLUTION: The registration image of a user is registered 
in a registered image DB 4 beforehand. In authenticating 
processing, the face image of the user is photographed 
from a camera 11 of an image input part 10 and an input 
image environment object estimating processing part 20 
analyzes the face image and estimates an environment 
parameter and an object state parameter. For example, 
an illumination parameter showing illumination 
conditions, a position parameter showing a photographing 
direction and a face size (depending on a standing 
position) or the like, an accessory parameter showing 
the presence/ absence of accessories such as eyeglasses 
and an expression parameter are estimated. A collation 
image generating processing part 30 extracts the 
registered image from the registered image DB 40 and 
generates a collation image by adjusting a parameter 
value with the estimated parameter value of the input 



image as a target. An image collating processing part 50 
compares and collates the collation image with the 
registered image. 
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t-a*JJH* (fliAESE*»S:«31+&*) <DT-*Xlh 
*K*Uffl£ft* 0 o.-^f->< >*7i-*g£6 0<7>i®fl> 

#U4. aw^Aais^gi*. ^BPaaE^t-coAWBaE 
ic^rai41®ffife*-&o o fc fed 4 <7>HMI4— MT-& 

>K T^'J ^- v 3 >K J: ^tOlIMtt^^ t 
Tl-5i t I4W^ itl)^ 5 o IH 4 <7)MTM4. ^Jffl#^ 
«ffi«O^SB^ SSHE^fftAWOi&WA*®^ iito 

**K»t^ftTv^ 0 
[ 0 0 3 3 ] HI 2 fi, *®f«K^ • »*y^fA 

[0034] if, $>bfrca>mm%~tizmfaEm<o& 

i^?lfcil**ffl*Ltfi<C^*WiLv» 0 wft 
l±M5&9. Lri@A^IE^#o T"/'J ^- v 

[ 0 0 3 5 ] ^tc. Oi^A^^ 10«*^7ll^li 

(Xf7yS 2 0 2 ) o C«077>^1 1 14®^<^)^ 

A*®«iB##*«iS$aS»2 0Ui8$ft4o 

[ 0 0 3 6 1 ^c, A*B««a»a»ai&3s» 2 0 

14. il^A^^l 0^<biS5ftfc®@l«4r»«f LT. « 
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j t Lxmm (hs i jfc-cco i=o. 6) . jfcm 
<D&m <±#) , *wo«* (i^*r) , #*j*sa>>* 

y*-9t LT» (JEM) , EftM-fr-fX (6 

cm) . fffiE&/<?> t LT, *rtt5Hci5V*T£! 
-feES$*tfct>»f«« <Mi&X 1 Y 1 -X 2 Y 2) . % 

^7>-nuM («x.tf3-K "o w ) tct: 

[0 0 3 7 ] jm*B«& 3 0 (4, 10 

^t*- ^^-^ 4 0 3&»e>BSE*t*O3pJffl*Ofi«H«t«) 

y/S 2 0 4) o Wxtf, flRW^7^-^ fc LTM 
(H S I*T?<0 1=0. 5) , 56iE0>ttia (Jt*) . 3fe 

(iEM) , Wi&m^J * (15cm) . ttm®^ 

ftra»*L (ffiAtfa - k "o" ) . 

S£W^n - ^> - ^ t LT&^tif (WiLtf 3 - K "0" ) X 
[0 0 3 8 ] Ba^H«^*«La» 3 0 14. fifiB&OlR 20 

AillHfcoJmW'*?-* £: H S I ^T'co 1=0. 
63&*<bl=0. 5Kf3StU 

*»t>fX6 c mfrb 1 5 cmCllL, #BI^7> 

-?<Di>\fmi& (nmx 1 y i 2 y 2) ^r^s^M 

[0 0 3 9 ] S«SS^«!jS» 5 0CJ:»), A*® 30 

Uf^S 2 0 5) o -s&fc L-c^ii^=£-^n^n 

H^£KI±OEf!B£ft#-*-&o *<btf*t:*!>S£5£LfcBfiE 

T^^.-^>r-r^o 4*3. 5 o it a 

£i&£M4 (0Hx.(iTl 0%) . llffeMP/fr&SKim&Iifft 

[0 0 4 0 ] Uk±&*m9im& • «*y*T- AO®H« 
[0 0 4 1 ] m±co £ o fc#£»3KJB5 1 <V\M&miZ • & 
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[0 0 4 2 1 (&iamm 2 ) *«?aa>*i6»ffl 2 <dw& 

»HS«3&*A»0««r^:Lfe«1i!i«-CA»j, A#£*i*:fU 
•bb^L. «ASSE*fT* 9 Bitflag . tfy^fAi 



[ 0 0 4 3 ] **Jfi3KS82 co©^h?.^ • Mv^fAco 
^«t^B& ^yXfACi: ^^S^HCO^^ * 

[0044] @ 5 1±. ^mtmm 2 <om&j&& • v 

[ 0 0 4 5 ] H 5 t-^-r J: o *!5Jfi«3ffi 2 

0 , ^IJ^T'- ^ -^-X 4 0 , 5 o 

*B98 2"Cliii1lfeflR^«ia»5 0 a 14. ®^^^5^#J^ 

si. r^>-)r/ K^BH-&5aa«5 2, s^#»t^ 

[ 0 0 4 6 1 IS^BB^jftaaS 5 0 a J2Jl^O*S*l4** 

Kffi 1 x-TF Ltz i><o t mux'&2><ox', z zxitmm* 



[0047] m&m&frtotos 1 »4, ®&zm®frm-t 

Z>&frX'$>z> 0 *SE*«S8 2<oaill«r-i4. 
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TBffe<0-tt*3SB«* LTfflOffiL. BBffc+ic-&3 
fiaBS*******'** h ^ (J£JLT\ BBffe'** h 

&o 3fc±3, RB««$fflL^fci&Oi7^«&£»«B 

m L ^ipJKff-T ^> £ Kiio 
[00481 7^y>«)0 K * ffi^ftSSl 5 2 14, * 

ttBffi i l * &*r£ m tz 43 tt -6 & j^&SI t ig*<0 

7u*3^Tfe«:i:±* x t . x 2 , x k co 3m<o^^m^ 
t/: 0 o m l *: «b« * k l « n l -c ig 7 t^-f x } 

5 2 14, ®*^ra±^45it*A*H«Oi6IB«C3l£«ja 
&Bfe iZ K L B e £ »i"ft *> •) K D C T g& * ft L T D 
[0 0 4 9 ] £<*ttttSNffi2B5 3 14, TAY^K V K 

xJf. B<0»JB«KI4£*#lt£ 3 t L. 
DO*lilfeSrfi*fl-lt 1 tt44W*4o *tfJL*:« 

[0 0 5 0] IS 6 14. *B«^ • MvXrAOi^ 
2b -£> o 

10 0 5 1 ] me iZTjk Lfc^f y/S6 0 1 a* <b * r y 
^S 6 0 4 t-CI4. *»3K!B 1 Ki3l/»TifcWL*:BI2 0!) 
7u-?-\-y\ t z&\ihJ.Ty-?S2Q ifrhA-ry? 
S 2 0 4 t^tt-C*9, C Cl-C<Oa*2.^l4^Bl&-r^o 

[0 0 5 2 ] #ctc, BlfeJB-Mk&SS 0 a©B««i£# 40 
#J^5 1 ta 007 ic^ Lit J: 9 jUjBtMsJt/S 
«Bffe**fc3ftBlfe*«J9ffi + (*-r*:/S 6 0 5) o 

[0 0 5 3 ] ^i:, BteSa^&affiffl 5 0 a<OT>(Y>^ 

4 > KcrfiR^ftLiiass 2 \z x <j ^ #«ii<fertA*s« 

Uf7^S 6 0 6) o 

[0 0 5 4 ] xt 7-/S 6 0 6 -CBBffeCTfc U;£ 

ISfcfHtL, *P>3^i:aoaSffiLfcL&^ttfca>Jt«lcJ: 50 
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*BIE*IBf-r& (X-f-y 6 0 7) o fOLi^M 

£#-£LTv*&;©^l4, B«J»/&*! : &fc:i3l* & ®^<0- 
0OB««*«6 1 L. 

[0 0 5 5 ] JtSl±OJ: 9^**«»ffi2 0B«JH^ • « 

«45 J: tm*«JE'*7 * - LT^JK Lfcflfi-& 

B«tS»B« J Sr»B«rt(cfiH-&+*i ffi 
-frfllffi*«3av»BlfefiR# • Sf^T^iit&ct^ 

[0056] (ie«?Bffl 3 ) *%w<D^mmm 3 com^ 

JS»# • »»v*-rAI4. 

*B«t««B«oSI**«cO |»v»r*^B«J!?.^*fr 

tt*3J:tm*tt!K/<? AAB^OSSa^^^ 

LT»^BIfe«r^JS:L. A*B« t »^B«t «r ra^feS 

[ 0 0 5 7 ] *^6163KJffi3 0B«fia^ • «*'>^fA© 
^ftS^OlSllft^HS U^-To i^CTI4B«HB^j&31g|5 
5 0W^MtLt, B«««^«0SR 5 1 . T4Yy 

s-ff ^ t o-c* %m&m 1 1 (-^ l tz x 7 \iZ 
a t \tm&mi&&.j£&m& 3 0 a tc*3»t&»ai*i*3ft** 

[ 0 0 5 8 ] m&M9L£.&i&m» 3 0 am»«>#S*l4 
HISBSl. *«3g!K2-C*L3t*>(0 4:H«T**^ 

[0 0 5 9] BR^BIfe^Jfi^aflS 3 0 a *4. ^^®f^^ 
mBLTre-frB#*&*1-&. ^^>^. B«A*«l 0 
^b^^^A/iA*lif^^^^L^^/^> 

L, eSBttf*-^^-^ 
4 0 frh*QL •) dJ L3tfiSB«OiSa[^7 ^ - ^ , ^t^tfe 
B^7^ - 9 *H*Lr«»B«^f>HR-&B««r^«;+ 
=5:43, ^H^f*-^^-X 4 0 (C^^/^->(7> 
fi»B«*S»L"C*3<c:4:lcj:0» \ljmm<Oft$.Vt 

s^9^ - n^ot <>iav»#ft«js/<^ ^ - * 

S»B««rSffiLT, fifl^B««r*JSLTA*B«i:© 
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[0 0 6 0] ifc. *»JKS82-CSa9iL*: -t d 3:^ 

£ G 00 
[0 0 6 1 ] ±I20J: oUSSHIR«:WS-t&- ti: <t 

[0 0 6 2 ] (*JM£ffi4) *ftW^I5«»JB4fl!>liffe 
^•Mv^rAli, *»®JB3tK*^, A*H« 

fcJfljRU 3&S«HilMrrji'*WSLTA;fc>IB 20 

[0 0 6 3 ] ***KS8 4 fnmqm& ■ Mv^fAW 
^#»jSo««ni, **3Bffli-rga^L>tiai. 

^^e 7*^**»iW $ fix * o 

[0064] it, mm%<omw«L*&»i,x , 3*5t 30 

[0 0 6 5 ] i9C^tJ:^:, 3 ^7t;^iif£^i 7 
-x-cwt, 2yk7cmmi&7'-fi l zM^xMmm% 3^ctc 

Ii5 &<DJj * 7 1 1 a - 1 1 e) ^'btt&^AfS^^tt 

U y>^;HfjL-*iS ( 1 i3<ni) * ?M$L) X&oX 40 

[0 0 6 6 ] #CK, «»LTDt>)i&A^#«..««H«* 
it^o 50 
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[0 0 6 7 ] ±U<DX dUftjS$*Lfc«#aW«.«0 3 
^7£^^ti3^7n^B^7'-^ £ LT. 2 #^8ilif& 

[0 0 6 8] #cU. m&W®L&tiu%MU 3 OtCiSlt&JeL 
^-*4 0 3^Sfc3*7cSHB#f*--* <t 2&%mW®L 
ftjRIBU*? J* - * K 2 ^7C^il^^^^i-^o 

PI^IL/;^, *<0±K2*5c8iiI«r*;*^*£Ki 

[ 0 0 6 9] &*3. 2*7C«Htt-r***-*-7 , -*Kft 

[0 0 7 0] tt<S0«*E^9 > - 9 . ftBi»^^^ > - 9 , 

- i±*Mi?gs8 1 xmrnttz^izx o 
lo o 7 1] ±t&<o&mzx ff«o«ja^e>oiiii 

* - 9 KftMLtzm&tt&mi%Z*k$L-f Z> t&X 

[0 0 7 2 ] xtiwmzmLxte, 2&7tmw{& 

<o»»XA^o 0D«A*9 I0^)^>7llli, 

H«flP.-&j-i5u»T, 2&.7tffiW{&-r-?<Dm 
[oo73] i^mmm 5 > ^u^ffi 5 <ommm& • « 

[0 0 7 4 ] 11 Oli, y^f A^M^M^^L 

tV^ 0 g| 1 0 C^-f" <fc -7 10 0 WB«BB^ • «* 

If-^^, 1 0 1 liHUfefiR^ • v-f 7 > 102 

i*i«c*$n^A*B«aa»aaffi«!f3a9 2 0. bs^os 
«*«i&a»3o, ssift7'-^^-A4 0. mwtm 
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^1^5 0, J--+fJ > ? 7 <K &£Zf. 

m&m& ■ ^t^7>(7> noi i*itz7f:$titzmi&x 
jjuiq\±, ztimmmmmi -4 icfcungc** 

n-^;ujci;r^*7 h7-^, * > * — * ^ h & * 

[0075] ^7>fr>h y--~jm&v>mwim& • 

& 0 if, mmm\t, b«a*su o<o#^ 1 
&frv>mm&*xt>'tz>o tot «>«jB?a#i±*ijffl*** 

BrSeteStct/lo :tci:^ * > 7 l l £&&&7U!i 

^lt^7 F7-^i^iaLTif?n, mmt>* 
y jL-x^/rLTli^MB^ • tt*-9--^ , <2 0 0 20 

nifcjm^ • 1 0 0 kz&^x%w&n 1 

y ^-va ^s&sfclHlfeira^ • M^7>f7> M01 
[ 0 0 7 6 1 ^±Oi 9 tc, ^^Olif^Hs^ . tjfcatv 

[0 0 7 7 ] (HffiJBffl 6 ) #«W«>*«3gJK 6U 

0S«flR^ • »5jfv*-r A*£3W A£f£ 30 

Ali, mi 1 fc®^LfcSE»*fr<0CT(^f -t -9 C 
D-ROM202 a-^7 v^^tM X^ 2 0 2 bf 
^l*«aB»«#2 0 2 *?ltTfc < . ^^7-^±K 

*&sa«»art<ofB»« j »2 0 1 ^ 3>^-^^ 

-Kf-f X^^r^cO|e^^#:2 0 4 c9v>-f o T i> 

Av» 0 yn^7 AHfrPStct*, 3&:/n ^7 A 14 =1 > e 
a - * 2 0 3li:n-fO^H, ±> ^eu±T^ff 40 

[0 0 7 8 ] 3<bfc. y-^ya^^A^^/^iH 
fcfctfXD&frfcl*, v»3bid>S*y h7-^ 2 0 5 ^^L 
T^7>f7Vf3> , ^-^ 2 0 3 (:77'l-; h 
U ? 7 4 T> h 3 > bfjL- * 2 0 3Jb"C>f > * 

[0 0 7 9 ] 

[*W«>a#] W±0 J: 0 K^^iif&m^ . fcs&y 
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7 > » * ilis J: E«tft«i»'< 7>-*te£g8i£ 

i*0 % ,3.-^7 W> K'J -4H«flB^ . ||#.>^fA* 
[0 0 8 0] *jSBOlifeJ!R^ • ftSv^f A 14, BB^ 

«L3aui5v»r. rc9&^A;&B^a»ib«S'<7*--* 
ift i eaiift * si«r 1 1:1^ t s - fc s , $ 

[0 0 8 1 ] *8MOi«ffl^-«*v^f 

jcanft^-f'jufcfflAu ^7>-^t^iiLU^ 

[0 0 8 2 ] *«WOB1&jm^ - tt*->*-rAli 

^7>f7>f^-Ay^fAi: Ltlifi^t^T 

^A*|B«Lfcl5«a#*3 > tf^-^tcg^^^ib-^^ 
[HffiOMJi.^^.^] 

[HI 1 1 *«W<0**^ffil OH^bb^ * 

A<7>m«&^^n 

[® 2 ] * j &m<D%mi&m 1 oii^m^ • 

[H 3 ] St^RB^^^ff 

[g|4] ^--^f-f>^-7^-^Sii6 0OS^8 6 1 C7) 

[B5] ^OHlM2<7)Ij|l^ -«sR->^x 
AORfl&«jfiH 

[@6] **^^*MJgffl2 <om®Lm& ■ «*v^-f 

[0 7] *»W«)Sej6JKff,2 0li«Ha^ - ^v^x 

[0 8] *»^0**Jgjg3 01i«BB^ • ft^v^T- 
A^B&i^i 
[S9] *»^^>**Jgffi4 ^®«fiP.^ • «Sr>*:r 

Aoa«B«^*a-f &v;u^tr^-«a;co*a^* 

[110] *M^iiii5 07 7>f7y 
yXfAt: J: ^Hi^ra^- . «*v^-r A^>»jRH 
[111] E»8#w« $r^-T El 
[^out^l 
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I 0 Mi&XlJ® 

II =7 

1 2 -fe^-* 

2 o A^HfttiftttSftiiftfttaffi 

3 0 !£6-ii&&j££! ! 31ffi 

4 0 ^P^r'-^^-X 

5 0. 5 0 a ®«ffi-&S3!afiS 

5 1 m®>mmfr®bm 

52 r^fr/^^ K^SS-S^aB 

5 3 m*tt\twm& 

60 J---»f--< 7x-^gji 

6 l liftoff 

6 2 
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m&m& - j 4 r v f 
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